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(57)Abstract: 

PROBLEM TO BE SOLVED: To make the position of an 
obstacle surely detectable by performing a processing 
(voting) adding a prescribed value to a position 
corresponding to a table in accordance with parallax 
obtained for every window for all windows and detecting a 
position having high value in the table of the results as an 
object. 

SOLUTION: Image signal inputted from respective cameras 
1 and 2 are stored in each image memory 3 and 4, a window 
setting means 5 sets a window for an image signal stored in 
one image memory 3 and a parallax calculating means 6 
obtains the position of an image having the highest similarity 
to the window among image signals stored in the other 
image memory 4 for every set window. A parallax and angle 
table 7 the parallax for every window is calculated from the 
obtained position is generated. Then, a voting means 8 
performs a vote in a prescribed value is added to a position 
corresponding to the table 7 for all windows, and an object 
detecting means 9 detects the position having a high value 
in the table 7 of the results as an object. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer.So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Obstruction detection equipment characterized by providing the following. The camera 
installed so that it might consist of two electronic-formula cameras carried in vehicles and both 
cameras might be mutually assembled on the line with the same horizontal axis of an image pck-up 
side in parallel [ an optical axis ] towards both vehicles front or back. Memory which memorizes 
temporarily the video signal which both the above-mentioned cameras picturized as a digital image. 
A window setting means to divide the picture of one camera for every window area of a 
predetermined size. By computing the degree of similar of the picture of the window concerned, and 
the picture of the camera of another side, and detecting the difference of a position with the picture 
position which was the highest as for the degree of similar with the camera of the window and 
another side concerned for every above-mentioned window The table which made a parallax 
calculation means to search for the parallax for every window, and the horizontal angle from the 
optical axis in each above-mentioned window and the value of parallax correspond to a horizontal 
axis and a vertical axis, By detecting the position more than a threshold predetermined in a vote 
means to add a predetermined value to the position where the above-mentioned table 
corresponding to the horizontal angle for every above-mentioned window and the value of the 
parallax in the window concerned corresponds, and the value of front Naka after the above- 
mentioned vote A body detection means to detect the body which exists in the vehicles front or 
back. 

[Claim 2] The obstruction detection equipment according to claim 1 carry out having had a distance 
calculation means compute a horizontal distance of even the body which carried out [ above- 
mentioned ] detection from the optical axis of the above-mentioned camera, based on the horizontal 
angle in which asks for the distance to the body which carried out [ above-mentioned ] detection 
from the above-mentioned camera based on the value of the parallax in the position for which it 
asked with the above-mentioned body detection means, and the body in the above-mentioned table 
which carried out [ above-mentioned ] detection exists, and the above-mentioned distance which 
found as the 

[Claim 3] The above-mentioned distance calculation means about the degree of similar for every 
pixel in the scanning zone for which it asked in each window in processing of the above-mentioned 
parallax calculation means The average of the degree of similar for which it asked for every window 
is calculated, a horizontal axis The difference of the position of the picture of both cameras, 
Obstruction detection equipment according to claim 2 characterized by what is been what makes 
parallax the value of the position which considers that the curve at the time of plotting a vertical 
axis in the graph made into the average of the degree of similar is a secondary curve, asks for the 
position where the curve serves as extremal value, and serves as the extremal value. 
[Claim 4] A brightness distribution calculation means to calculate the distributed value of the 
brightness on horizontal one line in the window concerned about two or more lines in each window 
set up with the above-mentioned window setting means, A distributed judgment means to judge 
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whether it is more than a threshold predetermined in the average or the aggregate value of a 
brightness distribution value in every line calculated with two or more above-mentioned lines, 
Obstruction detection equipment given in any of the claim 1 characterized by what was constituted 
so that processing after the above-mentioned parallax calculation means might be performed only 
about the window which are ****** and more than the above-mentioned predetermined threshold, 
or a claim 3 they are. 

[Claim 5] A degree storing means of similar to store the degree of similar for every pixel in the 
scanning zone for which it asked in each window in processing of the above-mentioned parallax 
calculation means, A difference calculation means to search for the difference of the average of the 
degree of full-similar for which is in a scanning zone and it asked for every window, and the value 
with the largest degree of similar in the scanning zone, Obstruction detection equipment given in 
any of the claim 1 characterized by what the value of the above-mentioned difference was equipped 
with a judgment means to judge whether it is more than a predetermined threshold, and was 
constituted so that only the parallax searched for in the window whose above-mentioned difference 
was more than a threshold might be used for the processing after the above-mentioned vote means, 
or a claim 4 they are. 

[Claim 6] The above-mentioned vote means is obstruction detection equipment given in any of the 
claim 1 characterized by what is constituted so that a predetermined value may be added to the 
position where the above-mentioned table corresponding to the horizontal angle for every above- 
mentioned window and the value of the parallax in the window concerned corresponds and a value 
smaller than the above-mentioned predetermined value may be added to the circumference, or a 
claim 5 they are. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention is technology applied to the crossing 
obstructing detector which is an object for automobiles, a speed regulating device, a brake operating 
unit, an automatic steering system, etc., concerning the technology of detecting a front obstruction 
using a stereo image processing, without being influenced by the color of an obstruction or a 
background, and asking for the horizontal position (distance from an optical axis) of the distance and 
the obstruction to the obstruction 
[0002] 

[Description of the Prior Art] As the conventional obstruction method of detection, there are some, 
which were indicated by JP,3~26921 1,A, for example. This method sets a precedence vehicle as a 
detection target, the existence of a precedence vehicle is judged by discovering the high position of 
the object nature of the right and left which are the feature of a precedence vehicle, and a 
brightness histogram, and the distance to a precedence vehicle is found by performing stereo 
matching in the position. 
[0003] 

[Problem(s) to be Solved by the Invention] However, in the method of the above-mentioned 
conventional example, since the bilateral-symmetry nature which is the feature of vehicles was 
used, there was a problem that it was difficult to detect obstructions other than vehicles. Moreover, 
in order to use the histogram of brightness, there was a problem that the detectivity force was 
influenced by the color of an obstruction and its background. 

[0004] It is made in order that this invention may solve the problem of the conventionaf technology 
like the above, and it aims at offering the obstruction detection equipment which can detect the 
position of an obstruction certainly irrespective of the configuration, color, and background color for 
detection. 
[0005] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, in this invention, it 
constitutes so that it may indicate to a claim. First, in invention according to claim 1, parallax 
(difference of the position of the picture reflected to each camera when one body was picturized 
with two cameras A and B with which the optical axis was installed by being parallel and separating 
a predetermined interval) is searched for for every window which set up and set the window as the 
whole stereo picture. And it uses that the window which shows the value of the same parallax as 
the direction when a body exists ahead solidifies. The table where the item of a table in every 
direction consists of the horizontal position (angle from an optical axis) and horizontal parallax of the 
window set up on the picture is made. According to the parallax searched for for every window, 
processing (vote) which adds a predetermined value to the position where the table corresponds is 
performed in all windows, and it constitutes so that an expensive position may be detected as a 
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body from front Naka of the result. According to this method, it becomes possible to detect two or 
more bodies simultaneously by the same processing irrespective of the form and color of the 
number of a detection body, or a detection object. In addition, the above-mentioned composition is 
equivalent to the gestalt of for example, the after-mentioned 1st operation. 

[0006] Next, in invention according to claim 2, it constitutes so that a horizontal distance of even 
the body which carried out [ above-mentioned ] detection from the optical axis of the above- 
mentioned camera may compute based on the horizontal angle in which asks for the distance to the 
body which carried out [ above-mentioned ] detection from the above-mentioned camera based on 
the value of the parallax in the position which asked for the above-mentioned body, and the body in 
the above-mentioned table which carried out [ above-mentioned ] detection exists, and the above- 
mentioned distance which found. Since the value of parallax corresponds to the distance from a 
camera to a body, the value of distance can be calculated by the principle of triangulation. In 
addition, the above-mentioned composition is equivalent to the gestalt of for example, the after- 
mentioned 2nd operation. 

[0007] Next, invention according to claim 3 computes distance according to claim 2 more precisely, 
and sets it to calculation processing of parallax. The average of the degree of similar for which it 
asked for every window is calculated, a horizontal axis The difference of the position of the picture 
of both cameras, It considers that the curve at the time of plotting a vertical axis in the graph made 
into the average of the degree of similar is a secondary curve, and asks for the position where the 
curve serves as extremal value, and it constitutes so that the value of the position used as the 
extremal value may be made into parallax. Thus, by constituting, the value of parallax can be 
computed to the value below a a small number of point, and so highly precise distance calculation 
can be performed. In addition, the above-mentioned composition is equivalent to a part of gestalt of 
for example, the after-mentioned 4th operation. 

[0008] next, the difference in the window where calculation of parallax is difficult since the method 
of asking for distribution of the parallax direction in a window is used as pretreatment of matching 
processing of the parallax calculation in every window in invention according to claim 4 — since 
calculation is omissible, processing becomes high-speed In addition, in order not to compute the 
parallax in the difficult window of matching, the reliability of the body detection which is after 
treatment improves. In addition, the above-mentioned composition is equivalent to a part of gestalt 
of for example, the after-mentioned 3rd operation. 

[0009] Next, in invention according to claim 5, it sets in the window which computed parallax. It 
responds to the size of the difference of the average of the degree of similar for every pixel in the 
scanning zone for which it asked in order to determine the parallax, and the position where the 
degree of similar is the highest. The reliability of the parallax searched for is judged, and it - 
constitutes so that high, the low thing of reliability, i.e., possibility of incorrect detection, parallax 
may not be used for the vote to a table. By this composition, incorrect detection can decrease and 
the reliability of body detection can be raised. In addition, the above-mentioned composition is 
equivalent to a part of gestalt of for example, the after-mentioned 3rd operation. 
[0010] Next, in invention according to claim 6, it becomes easy to detect the body detected as that 
from which parallax differs by 1 pixel by the quantization error etc. in spite of existing in the same 
distance by having constituted so that a low value might be added also to the frame of the 
circumference as the same body in the case of the vote to a table. Moreover, since a crotch can 
make a value reflect [ edge / characteristic / of an obstruction ] a ** case etc. in the next window 
comrade in the window of two ******, detection of an obstruction becomes certain. In addition, the 
above-mentioned composition is equivalent to a part of form of for example, the after-mentioned 
4th operation. 
[0011] 

[Effect of the Invention] According to this invention, the effect of becoming possible to detect two 
or more bodies correctly simultaneously by the same processing is acquired irrespective of the form 
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and color of the number of a detection body, or a detection body. Moreover, in a claim 2, the 
distance from a camera to a detection body and a horizontal distance of the optical axis of a camera 
to a detection body are computable. Moreover, in a claim 3, distance is more computable to high 
degree of accuracy. Moreover, processing is accelerable while the reliability of body detection 
improves in a claim 4. Moreover, incorrect detection is decreased in a claim 5 and a claim 6, and the 
effect that the reliability of body detection can be raised is acquired. 
[0012] 

[Embodiments of the Invention] (Gestalt of the 1st operation) Drawing 1 is the block diagram 
showing the 1st composition of the gestalt of operation. In drawing 1 , 1 and 2 are the cameras of an 
electronic formula, turn [ anterior part / of a self-vehicle ] to the front, and are installed in it, and 
the optical axis of both cameras is installed so that the horizontal axis of an image pck-up side may 
gather on the same line in parallel with mutual. In addition, back can be turned and installed in the 
posterior part of vehicles, and it can also constitute so that the obstruction of vehicles back may be 
detected. 20 is detection objects, such as an obstruction which exists ahead of a self-vehicle, and 
has illustrated the precedence vehicle in drawing 1 . 30 is operation part, for example, consists of 
microcomputers which consist of CPU, RAM, a ROM, etc. In operation part 30,3 and 4 are image 
memories which memorize the picture signal inputted from cameras 1 and 2, respectively. Moreover, 
5 is a body detection means to detect the body ahead of vehicles, when 5-9 show the content of an 
operation in operation part 30 with a block, a window setting means and 6 detect a parallax 
calculation means and 7 detects the table of the degree of parallactic angle, and the position more 
than a threshold predetermined [ 8 / Table 7 to ] in a vote means and 9. About each of these 
meanses in operation part 30, a detail is mentioned later. 

[0013] Drawing 2 is drawing explaining the principle which finds the distance from a camera to the 
candidate for detection by the principle of triangulation using a stereo picture. In drawing 2 , Picture 
B shows the picture which picturized the picture picturized with Camera A (equivalent to the 
aforementioned camera 1) with Picture A and Camera B (equivalent to the aforementioned camera 
2), and the position for detection is made into Point p (x y, z). 

[0014] If things can be carried out in quest of the matching positions xa and xb between the 
pictures of two sheets in the stereo picture which a focal distance f and interocular distance 
(distance between both cameras) D are known, and the optical axis picturized with two parallel 
cameras A and B mutually so that drawing 2 may show, the distance Z from a camera to Object p 
can be found from the following (several 1) formula. 
[0015] 

Z=f-D/(xa-xb) =f-D/S — (several 1 ) 

However, like drawing 2 , it is parallax, and the optical axis of xa-xb=S is parallel, and when one body 
is picturized with two cameras A and B installed by separating a predetermined interval, it is the 
difference of the position xa in the difference A of the position of the picture reflected to each 
camera, i.e., a picture, and the position xb in Picture B. In addition, in this example, m, a focal 
distance f, parallax S, and the unit of positions xa and xb of the unit of interocular distance D and 
Distance Z are pixels. For example, when Cameras A and B set the number of pixels to 640x480 
using CCD, the size of 1 pixel is about 10 micrometers. 

[0016] Although the focal distance f of the above-mentioned (several 1) formula has calculated the 
unit as a pixel, generally as for a focal distance f, a unit is expressed with mm in many cases. In 
order for a unit to convert it into the value which is a pixel, it can be asked to be shown in drawing 3 
by the following (several 2) formula by detecting the number wx of pixels of the object on the 
picture which picturizes the object of width-of-face W (mm) which the size understands at the 
place distance z (mm) Distant, and is then picturized by image processings, such as an edge 
detection. 

[001 7] f=z-wx/W — (several 2) 

However, the unit of wx and f needs to detect the point (xa, ya) on the picture (for example, the 
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picture A) of another side corresponding to the point (xb, yb) that Point p is picturized on one 
picture (for example, the picture B), in order for a pixel and the unit of z and W to detect mm and 
the above-mentioned parallax S. As the method, the picture (window) of a certain range including 
the point on Picture B (xb, yb) and the most similar range can be searched for by searching out of 
Picture A. There are a finite difference method, a normalization correlation technique, etc. between 
pictures in calculation of this degree of similar. 

[0018] Drawing 4 is drawing showing the result which searched for the parallax for every position to 
which both pictures correspond, in detail By cutting one picture (for example, the picture B) for 
every window, and asking for the position of the window and a picture with the highest degree of 
similar from the picture (for example, the picture A) of another side in all those windows in the 
picture which picturized the passage front The corresponding position in both pictures is detected 
and the result which searched for the parallax for every window from each corresponding position is 
expressed. In drawing 4 , as for a left picture (equivalent to Picture A), and (B), (A) shows the 
picture in which a right picture (equivalent to Picture B) and (C) extracted the table of parallax, and, 
as for (D), parallax extracted only the window portion of "15." Moreover, (1) - (20) of drawing 4 (B) 
and (C) shows the position of the horizontal direction (it is hereafter described as a longitudinal 
direction) of each window, and is equivalent to a lateral angle (it explains in full detail by drawing 5 ). 
However, (1) - (20) is expressed with the number with a round head in drawing. Moreover, width of 
face (the length of x directions) is [ xw and the height (the length of the direction of y) of one 
window ] yw(s). As mentioned above, if the parallax for every window is known, the distance to the 
body currently picturized by the corresponding window can be found by using the aforementioned 
(several 1) formula. 

[0019] The picture which searched for the parallax to the body currently hereafter picturized by the 
interior for every window like drawing 4 will be called "depth map." Since it is equivalent to the 
distance to the body which the parallax computed for every window of this is picturized inside the 
window concerned, and has characteristic portions, such as an edge, if one object is picturized 
ranging over two or more windows, the same parallax will be searched for in an adjoining window. For 
example, since a precedence vehicle and the road surface of the right under where a precedence 
vehicle exists are these distance in the case of the depth map in the picture which picturized the 
passage front, as the window of a thick line shows to drawing 4 (D), the window on the same y- 
coordinate as the lower part of a precedence vehicle is computed with the same parallax as a 
precedence vehicle. For example, it is equivalent to the above-mentioned portion that "15" is 
following the lower shell of the 2nd line of drawing 4 (C) at the longitudinal direction. In addition, in 
drawing 4 (C), the portion to which parallax "15" has gathered to a part for a center section is 
equivalent to a precedence vehicle, the portion to which parallax "19" has gathered in (3) and (4) 
trains is equivalent to "a left tree", and the portion in which parallax "5" is following (6) trains is 
equivalent to "a central tree." 

[0020] Drawing 5 is drawing having shown the angle picturized in the window set up on the picture 
to two cameras 21 and 22 with the precedence vehicle 23 and the physical relationship of two trees 
24 (equivalent to the tree of the aforementioned left), and 25 (equivalent to the tree of the center of 
the above) of the width, when the picture shown in drawing 4 is picturized with a camera. 
[0021] Moreover, it is drawing [ parallax ] having shown the table (it is hereafter called the table for 
vote) of the degree of parallactic angle where took drawing 6 to lengthwise and it took the angle [(1) 
- (20) of drawing 4 and drawing 5 ] in the longitudinal direction, and a left picture and (B) show a 
right picture, and, as for (A), (C) shows the table for the above-mentioned vote. 
[0022] Moreover, drawing 7 is drawing showing signs that its vote is cast for the position in 
corresponding front Naka based on the position of the longitudinal direction of the parallax searched 
for in a certain window on a depth map, and its window, in (A), a right picture and (B) show the table 
of parallax, and (C) shows the table for vote. In addition, "vote" in this case means adding to a 
certain angular position and the position of the value of the parallax corresponding to it every [ 1 / 
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+]. For example, when one parallax "15" exists in the position of an angle (8), is added to the 
position of parallax "15" at an angle of drawing 7 (C) (8). In the example of drawing 7 (B), since five 
parallax "15" exists in the position of an angle (8), finally its vote will be cast for "5" at an angle (8) 
in the position of parallax "15." 

[0023] Moreover, drawing 8 is drawing showing the result which went the above-mentioned vote in 
all windows, in (A), a right picture and (B) show the table of parallax, and (C) shows the table for 
vote. 

[0024] In the window set up by drawing 4 , the window of the position where a longitudinal direction 
is the same picturizes the same direction so that drawing 5 may show. Moreover, when a body 
exists ahead so that drawing 8 may show, in the portion which is detecting the body, the parallax 
with the same window lengthwise [ on the same x-coordinate ] is searched for, and the same 
parallax is searched for in the window of the longitudinal direction on the same y-coordinate by the 
case where a body does not exist on a road surface. Since the number of times of vote to the value 
to the direction and parallax will increase if its vote is cast for a table by th^ method shown in 
drawing 7 using such a depth map, and the same parallax as the same direction (on the same x- 
coordinate) is located in a line, the value of the position becomes high. Therefore, the existence of a 
front body is detectable by looking for the position of drawing 8 where a front shell value is high. In 
the example shown in drawing 8 , vote concentrates at the portion (equivalent to a left tree) of 
parallax "19", and an angle (5) by the angle (3) and (4), and concentrates in the portion (equivalent 
to a precedence vehicle) of parallax "15" by the portion (equivalent to a central tree) of parallax 
"5", and angle (8) - (16), and the value is high. 

[0025] By the above-mentioned method, a setup of the threshold of the value looked for from a 
table can also adjust the height of the body made applicable to detection, and detection of two or 
more bodies can also perform detection of one body by the same processing regardless of the form 
and color of an object. 

[0026] In the gestalt of the 1st operation shown in drawing 1 , each above-mentioned function is 
shown as each means, each above-mentioned window is set up with the window setting means 5, 
and the above-mentioned parallax is computed with the parallax calculation means 6. Moreover, 
Table (table for vote) 7 of the degree of parallactic angle is equivalent to above-mentioned drawing 
7 (C), the vote means 8 performs vote explained by drawing 7 , and the body detection means 9 
detects the body which exists ahead [ vehicles ] by detecting the position more than the front shell 
predetermined threshold shown in drawing 8 (C). 

[0027] As explained above, it sets in the gestalt of the 1st operation. It uses that the window which 
shows the same parallax as the same direction will solidify if a body exists ahead. By adding a value 
to the position where front Naka which consists of an angle and parallax the defined parallax 
searched for for every window based on the angle of the longitudinal direction of the window 
corresponds, and looking for an expensive position from front Naka of the result which performed 
the operation in all windows, it constitutes so that a body may be detected. Therefore, two or more 
bodies can also detect one body by the same technique, and can detect a body now, without being 
influenced by the color of the background for detection. Moreover, since road marking, such as a 
white line and a stop line, does not appear in the direction where the window which shows the same 
parallax is the same, they also has the advantage that incorrect-detecting road marking and an 
obstruction with height is lost. In addition, since only the depth map is used, two or more bodies are 
detectable by the same processing irrespective of a color, or the configuration and background color 
for detection. 

[0028] (Form of the 2nd operation) Next, drawing 9 is the block diagram showing the form of the 2nd 
operation. This forms the distance calculation means 10 in the degree of the body detection means 
9 in aforementioned drawing 1 , and other portions are the same as that of drawing 1 . The distance 
calculation means 10 computes the distance from a camera to a detection body, and lateral 
positions (x1 of the distance of the x directions of [ from an optical axis to an object ], for example, 
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drawing 5 , x2, etc.). As the form of implementation of the above 1st explained, since the value of 
the horizontal axis and vertical axis expresses the parallax and the direction of the body, the 
position (position which shows the value beyond a predetermined value) detected from front Naka of 
drawing 8 (C) can ask for the distance to a body, and a lateral position by using this value. 
[0029] Hereafter, the calculation method is explained. First, the distance to a body is found. The 
distance to the detected body is calculable with the principle mentioned above, if parallax is 
detectable. Therefore, by substituting for drawing 8 (C) the value (the above "19", "4", and "15") of 
the parallax with which the body was detected at S of the aforementioned (several 1) formula, the 
distance to "a left tree", "a central tree", and a "precedence vehicle" can be found, respectively. 
[0030] Next, it asks for a lateral position. (1) - (20) expresses the angle from the lens center 
picturized for every window so that drawing 5 may show. It can ask for the angle theta for every 
window by the following (several 3) formula geometrically. 
Theta=tan~1 (xw/f) — (several 3) 

In addition, xw is the size of the longitudinal direction of one window. Moreoyer, the unit of xw and f 
is a pixel. 

[0031] Since the position XL (distance of the x directions of [ from an optical axis to a body ]) of an 
objective longitudinal direction is in the physical relationship shown in drawing 5 , based on the angle 
of the distance found by the formula (several 1), and a table, it can ask for it by the following 
(several 4) formula. 

XL=Z-tan [(N-M )-theta] ~ (several 4) 

However, the turn from the left end of a window that the body was detected, as for N, and M show 
the turn from the left end of the window on an optical axis. For example, when 10 [a left end to the 
10th (the 10)] and the detection body of M are precedence vehicles in the case of drawing 5 , N is 7 
[a left end to the 7th (the 7)]. In addition, when XL<0 has a body on the right of an optical axis, 
XL>0 shows the time of being in left-hand side. Moreover, the unit of Distance Z and the longitudinal 
direction position XL is m. 

[0032] Since the left end of the precedence vehicle whose distance Z the direction of an optical 
axis is an angle (10), and is L1 is picturized by the angle (7) in the case of the example of drawing 5 , 
the longitudinal direction position x1 from the optical axis at the left end of this precedence vehicle 
is x1=L1 and tan[(7-10 )-theta] =-L1 f and tan (3theta). 

It comes out. Moreover, since the tree of the left whose distance is L2 is picturized by the angle (3), 
a lateral position is x2=L2 and tan[(3-10 )-theta] =-L1, and tan (7theta). 

It comes out. The distance calculation means 10 of drawing 9 shows the above-mentioned contents 
of an operation. In addition, the form of the after-mentioned 4th operation explains how to perform 
distance calculation to high degree of accuracy more. 

[0033] As explained above, in the form of the 2nd operation, the position whose front shell value 
created with the form of the 1st operation is more than a threshold is detected, and distance is 
computed based on the parallax of the position, and it constitutes so that a lateral (horizontal) 
position may be calculated based on the direction of the position, and the found distance. Therefore, 
both the distance to a body and a lateral position are calculable after body detection only by the 
few time and effort of triangulation and the proportion using the position of a table. Moreover, since 
distance and a position can be calculated only by giving same calculation in the position more than 
the threshold of front Naka, without scanning the whole picture again even when there are two or 
more bodies, objective distance and measurement of a position can be performed at high speed. 
[0034] (Form of the 3rd operation) Drawing 10 is the block diagram showing the form of operation of 
the 3rd of this invention. In addition to the composition of aforementioned drawing 9 , the form of 
this operation establishes the brightness distribution calculation means 11, the distributed judgment 
means 12,. the degree storing means 13 of similar, the difference calculation means 14, and the 
judgment means 1 5, and prepares the function to prevent incorrect detection of an obstruction. 
[0035] Drawing 1 1 is drawing for explaining the function to prevent objective incorrect detection. 
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drawing 1 1 (A) When a star type figure as been drawing showing the picture of each window set up 
on the processing-object picture and shown in drawing 1 1 (B) is picturized The window where (a) of 
drawing 1 1 (A) has a plain window (portion without the picturized figure), and (b) has an edge only in 
the direction parallel to parallax, the window in which (c) has an edge, and (d) show the window 
containing a noise, and the graph shown under each figure in (a) - (d) — difference — the 
difference for which searched for parallax and it asked for every (parallax) pixel by matching — a 
value — a vertical axis — difference — they are graph-ized, using a value and a horizontal axis as 
parallax, and the state of asking for a matching position (difference position [ of the value minimum ] 
= position of the maximum [ degree / of similar ]) is expressed by looking for the minimum value 
from the graph 

[0036] moreover, (a) - (d) which defined drawing 1 1 (B) on the picture — it is drawing showing the 
positions of each window, and those defined scanning zones of a window Moreover, drawing 1 1 (C) is 
drawing showing the state of asking for the brightness distribution on one line cut in the parallax 
direction by two or more places, in each window (a) - (d). Moreover, drawing 1 1 (D) is drawing 
showing physical relationship when the object picturized with two cameras and its object are 
picturized on a picture. 

[0037] In addition, the above-mentioned difference is total of the brightness difference for every 
pixel of a criteria picture and the picture of another side, and the degree of similar serves as size, so 
that difference is small. Usually, the degree of similar and difference are expressed with the 
following formula. 

Z(x-xJKy-x) 

- 1 smsim= S 1 

/- CS(x-jc) 2 ] r C2<y-x) 2 3 
0^#=2 I x-y I ^It^^$xWg^f 

In addition, for x, in an upper formula, the brightness of a criteria picture (picture A) and x are [ the 
brightness of the picture (picture B) of another side and y of the average of x and y ] the averages 
of y. 

[0038] When two cameras are installed so that the same line of an image pck-up side may be 
located in a line on the same straight line as shown in aforementioned drawing 2 , the matching 
position on a mutual picture gets on the same line. It asks by performing 1 pixel of search of a 
similar picture at a time with staggering in the parallax direction on the same line from this, as 
shown in drawing 1 1 . and the parallax of the window — this operation — setting — most — 
difference — it asks as a difference of the position where the picture judged that a value is low 
exists, and the position which defined the window of a criteria picture Moreover, when a right 
picture is made into a criteria picture, the matching position with the window defined on the right 
picture becomes on a left picture on the right of the position which defined the window by the right 
picture, as shown in drawing 1 1 (D). That is, parallax serves as a gap from the starting point of a 
scan to a matching position that what is necessary is just to scan the search range of a picture 
rightward from the position which defined the window by the right picture. The example of drawing 
1 1 came to have shown to the graph of (c) of drawing 1 1 (A). 

[0039] as mentioned above, the difference which asked for drawing 1 1 (A) for every pixel in each of 
four windows — the relation between a value (difference of a criteria picture and the picture which 
asked for difference), and parallax (difference of the position of a criteria picture and the picture 

which asked for difference) — a graph izing — difference — the case of matching — difference 

— the position of the minimum [ value ] turns into highest position of the degree of similar However, 
as shown in (a) of drawing 1 1 (A), since difference becomes being a plain picture with the same 
value in every position, also in a window, neither of search range of a window can also determine 
parallax, for example. Since there is a small noise also in such a window, although the difference of a 
value which is different in each position will be called for and the position of the minimum value will 
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also be called for by the real picture, since it is not that to which this position detected objective 
parallax in such a case, if this parallax is used for body detection, it will become the cause of 
incorrect detection, moreover — although the edge considered to be objective [ some ] is picturized 
in the window which has only an edge parallel to parallax as shown in (b) of drawing 1 1 (A) — (a) — 
the same — difference — since a value is in a scanning zone and is the same value altogether, the 
parallax searched for has high possibility of not being exact That is, since the parallax searched for 
has high possibility of becoming the cause of incorrect measurement case, as shown in the above 
(a) and (b), it can be said that parallax should not be searched for. 

[0040] Hereafter, the method of removing the factor of the above incorrect detection is explained. 
Drawing 1 1 (C) is drawing showing the state where it asked for the brightness distribution on the 
side of one line cut in the parallax direction in each window by two or more places. Brightness 
distribution of the window beside [ which was cut by parallax and parallel ] one line serves as a 
value small [ both ] also in the window of solid color as shown in (a) also in the window which has an 
edge only in the direction parallel to parallax as shown in (b). On the contrary, as shown in (c), in the 
window which can compute parallax, distribution becomes large. 

[0041] Moreover, if the brightness distribution in [ whole ] a window is calculated, although 
distribution will become small in the window of the solid color of (a), distribution of the window of (b) 
will become large. However, if the distribution beside one line is computed as shown in drawing 1 1 
(C), since distribution becomes small, both (a) and (b) can detect correctly the window where 
parallax calculation is unsuitable. Thus, if it judges whether it is appropriate to search for parallax 
based on the sum total or the average of distribution on [ of two or more places ] one line before 
matching, the window of incorrect detection can be removed and computational complexity can be 
cut down simultaneously. 

[0042] moreover, the difference which showed calculation of parallax to drawing 1 1 (A) — in order 
to carry out by looking for the position of the minimum value from the graph of a value, the certainty 
of the parallax searched for will become low like the picture in which the value near the minimum 
value has only an edge with what [ parallel to a plain window or the parallax direction ] is seen by 
two or more places although the distribution for which it asked by the method of above-mentioned 
drawing 1 1 (C) becomes large by the picture which has a noise as shown in (d) of drawing 1 1 (A) — 
difference — since the value very near the minimum value is calculated by two or more places, the 
graph of a value is difficult for concluding parallax from the inside the difference called for 
temporarily — possibility that this position is an incorrect correspondence position also considering 
the value minimum position as parallax is high Therefore, it is better not to search for parallax in 
such a case. Therefore, the following methods are used. 

[0043] the difference for which is in a scanning zone and it asked as shown in drawing 1 1 (A) — the 
average of a value, and the minimum in it — difference, if a value is calculated the whole difference 
— when the value near the minimum value among values appears mostly, the difference of the 
average of difference and the minimum value of difference which are matching within the limits and 
were calculated becomes small — That is, when the difference of these two values is smaller than a 
certain threshold, it can be judged that the parallax searched for in the window is high corresponding 
to incorrect. Therefore, the parallax judged that the possibility dealing with incorrect is high in the 
above-mentioned judgment can make objective detection more reliable, if it is made not to use for 
the vote to the table which is next processing. In addition, although it has taken difference along the 
vertical axis, the graph of above-mentioned drawing 1 1 (A) is judged to be incorrect 
correspondence, when the degree of similar of the inverse number of difference is taken and the 
difference of the maximum of the degree of similar and the average of the degree of similar is 
smaller than a predetermined threshold. 

[0044] As mentioned above, since the possibility of incorrect correspondence is high when the 
difference (difference of the maximum of the degree of similar and the average of the degree of 
similar) of the average of difference and the minimum value of difference which the brightness 
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distribution on the side of one line cut in the parallax direction in each window is matching within the 
limits, and calculated in each line when small is small, body detection can be made more reliable by 
making it not use the parallax searched for in the window. 

[0045] In the form of the 3rd operation, the distribution for every above-mentioned side of one line 
is computed with the brightness distribution calculation means 11, and the above-mentioned 
distribution judges whether it is size from a predetermined threshold with the distributed judgment 
means 12. And only when distribution is more than a threshold, parallax by the parallax calculation 
means 6 is computed, moreover, the degree storing means 13 of similar — the degree of similar in a 
scanning zone (difference value) — storing — the difference calculation means 14 — (of the degree 
of similar — maximum-average: — difference — in the case of a value, average-minimum value) is 
calculated, and the above (maximum-average) judges whether it is more than a predetermined 
threshold with the judgment means 1 5, and it constitutes so that vote in the following vote means 8 
may be performed only in more than a threshold 

[0046] difference [ in / the window which cannot compute parallax / since the method of asking for 
distribution of the parallax direction in a window is used as pretreatment of matching processing of 
the parallax calculation in every window in the form of the 3rd operation as explained above ] — 
since calculation is omissible, processing becomes high-speed In addition, in order not to compute 
the parallax in the difficult window of matching, the reliability of the body detection which is after 
treatment improves. 

[0047] Moreover, it responds to the size of the difference of the average of the difference for every 
pixel in the scanning zone for which it asked in the window which computed parallax in order to 
determine the parallax, and the position where difference is the lowest. The reliability of the parallax 
searched for is judged, in order to take the method of not using for the vote to a table what has low 
reliability, i.e., parallax with the high possibility of incorrect detection, incorrect detection decreases 
and the reliability of body detection improves. 

[0048] (Form of the 4th operation) Drawing 12 is the block diagram showing the form of operation of 
the 4th of this invention. In the composition of aforementioned drawing 10 , the form of this 
operation changes the contents of a vote means and a distance calculation means, and prepares the 
function which high-degree-of-accuracy-izes objective detection and the value of the computed 
distance. In drawing 12 , 16 shows a vote means and 17 shows a distance calculation means. 
[0049] First, highly precise-ized processing of body detection is explained. Drawing 13 is drawing for 
explaining highly precise-ized processing of the body detection by the vote method. The result 
which left only the parallax of the high window of certainty by the method explained by drawing 1 1 is 
used. In case its vote is cast to the table for vote shown in drawing 7 , it is drawing showing the 
state of adding a low value to the position which adjoins the position in a high value in the - 
corresponding position based on the direction and parallax of a window which detected parallax. 
[0050] Since there is a quantization error in a digital image, it occurs mostly that 1 pixel of parallax 
differs also in two windows cut on the body in the same distance. Since the edge used as the 
criteria of parallax calculation serves as only an objective profile when the interior makes a plain 
body applicable to detection like a precedence vehicle especially, such a thing happens mostly. In 
addition, since calculation of parallax can do only the window where, as for a plain body, the interior 
contains the profile, the same parallax is not detected as a lump, and although the edge is the 
window which has detected the same body to a picture in being slanting, the same parallax is not 
detected in the window of the same direction. Thus, by the simple vote method shown in drawing 7 , 
if the values of the parallax which should originally become the same differ, since the values of 
parallax differ in each direction (window located in a line on the same x-coordinate) and the same 
value is not detected continuously, a body is undetectable. Therefore, it is made to cast its vote for 
the part which does not vote one vote but corresponds to the corresponding part simply, and its 
contiguity part in drawing 13 . In the example shown in drawing 13 , by (8), an angle puts three votes 
into the above-mentioned part, when parallax votes for the part of "15", it puts two votes into the 
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part of the upper and lower sides, respectively, and votes for a part on either side, respectively, 
thus, mutual, when carrying out, and the difference in the parallax by the quantization error can be 
mutual-boiled, and can be made to reflect and the same parallax is detected in a ****** window — 
since vote in which resembled and that was made to reflect can be performed, and the interior is 
solid color, for example, it can prevent un-detecting [ of the body which cannot search for parallax 
easily ] 

[0051] Next, highly precise-ized processing of distance calculation is explained. Drawing 14 is 
drawing showing the graph which added the average of difference, and drawing 14 (A) is drawing 
having shown the window which was able to search for parallax on the picture. In the window which 
voted drawing 14 (B) for the part which showed the value more than the threshold of front Naka the 
difference for every pixel for which it asked at the time of matching — the difference for which it 
asked in the position for L/2 pixel of right and left of the position called for as parallax of the 
window into the graph and graph of a value — it is drawing having shown the graph (average of the 
value which all came out and was calculated in the position for L pixels) of the average of a value 
[0052] As mentioned above, the distance to the body detected by the table of drawing 7 is 
calculable by substituting the lengthwise position (parallax) of front Naka for the aforementioned 
(several 1) formula. However, since the parallax searched for from a table is an integer unit, its range 
accuracy is bad. objective parallax — difference — the portion to which a value becomes the 
smallest — it is — this difference — the value is carrying out the configuration near the secondary 
curve which makes extremal value the position near the parallax searched for as an integer so that 
the graph of drawing 14 might also show That is, parallax can be searched for in a finer unit by 
searching for parallax as extremal value of this secondary curve. Furthermore, since objective 
parallax is searched for in two or more windows which start on a body here, the difference for every 
pixel in the scanning zone for which it asked in all these windows — by asking for the average of a 
value and making into parallax the position which takes the extremal value at the time for the graph 
of the average the bottom wholly as a secondary curve The parallax in which the result of all the 
windows that detected the body was made to reflect can be computed now, and a more exact and 
highly precise distance can be computed now. In addition, although the case where a secondary 
curve was resembled was illustrated in the above-mentioned example, it may not restrict to this and 
a higher order curve may be resembled. 

[0053] In the form of operation of drawing 1 2 , in the vote means 16, highly precise-ized processing 
of the body detection explained by drawing 13 is performed, and highly precise-ized processing of 
the distance calculation explained by drawing 14 is performed with the distance calculation means 
17. 

[0054] Since the method of adding a low value also to the frame of the circumference was taken in 
the form of the 4th operation at the time of the vote to a table as explained above, it becomes easy 
to detect the body detected as that from which parallax differs by 1 pixel by the quantization error 
etc. in spite of being in the same distance as the same body. Moreover, since a crotch can make a 
value reflect [ edge / characteristic / objective ] a ** case etc. in the next window comrade in the 
window of two ******, objective detection becomes certain. <BR> [0055] Moreover, in case the 
distance of the body discovered in front Naka is calculated, the average of the difference in all the 
windows used as the basis added to the position which is more than the threshold of front Naka for 
which it asked for every parallax is calculated. Since the position where it considers that the made 
curve is a secondary curve, and the curve serves as extremal value is made into parallax when a 
vertical axis is made into the average and a horizontal axis is made into parallax, it becomes possible 
to search for the parallax searched for only per pixel per small number, and it can compute distance 
to high degree of accuracy more. 

[0056] (Example) Next, the example which measures the distance to two trees which are ahead 
[ road ], and a precedence vehicle, and the position of those longitudinal directions is explained 
using the form of the 1st explained until now - the 4th operation. Here, as shown in aforementioned 
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drawing 2 , the stereoscopic camera arranged so that the optical axis of two cameras may become 
parallel and the y-axis of two cameras may get on the same line will be used. 

[0057] Drawing 15 is the flow chart of the processing in this example. In drawing 15 , initial setting is 
first performed at Step S100. In this initial setting, the table for value storing used while processing, 
before inputting a new picture is cleared, the difference for which it asked for every window as 
shows the table which performs initial setting here to drawing 16 — they are a table for storing a 
value (the after-mentioned step S104 explaining), and a table for storing the parallax searched for 
for every window as shown in drawing 17 In addition, in the table for parallax storing shown in 
drawing 1 7 (C) and (D), what is indicated to be "-1" is a flag which shows that parallax is not 
searched for, and shows the state (all parts are set as "-1") where drawing 17 (C) initialized. 
[0058] Next, a picture input is performed at Step S101. Here, Picture A and Picture B of 
aforementioned drawing 2 are inputted. Next, Step S102 defines a window on one of pictures 
(setup). As shown in aforementioned drawing 4 here, ten pieces are defined perpendicularly and 20 
windows [ a total of ten x20 ] are defined horizontally. 

[0059] Next, in Steps S103-S106, parallax is detected in all the defined windows and the result is 
voted to a table. First, a distributed check is performed at Step S103. That is, in the window of the 
first processing object, processing explained by drawing 11 (C) is performed, the case where it shifts 
to processing of the next window, without carrying out anything when the distribution for which it 
asked by this method is below a threshold, and distribution is more than a threshold — Step S104 - 
- difference — parallax is computed by performing matching processing This matching processing is 
the processing explained by aforementioned drawing 1 1 (B). the difference for every pixel for which 
it asked at this time — since a value is used by the reliability judgment (Step S105) of parallax and 
the highly precise-ized processing (Step S1 10) of parallax which are performed behind, it stores in 
the table of drawing 16 for every window In addition, the step to store omitted illustration. 
[0060] next, at Step S105, in order to investigate the certainty of the computed parallax, it asked in 
the window — all — difference — the average of a value, and the minimum — difference — a 
difference with a value is searched for and the difference judges whether it is more than a 
predetermined threshold This processing is the processing explained by aforementioned drawing 1 1 
(A). In this judgment, after performing vote to a table at Step S106 with [ the difference of the 
average and the minimum value ] a threshold [ more than ], it moves to processing of the next 
window, and when smaller than a threshold, it moves to processing of the next window, without 
performing vote to a table. Moreover, since the parallax searched for in each window is used by 
highly preciseHzed processing of parallax, the table for parallax storing of the same size as the 
number of the windows defined in all directions on a picture is prepared, and when the high parallax 
of certainty is searched for, the parallax searched for in the window is stored in the position-where 
it corresponds in a table. It is the table after drawing 17 (D) stores parallax. In addition, the step to 
store omitted illustration. 

[0061] In the above-mentioned step S106, whichever of the method of aforementioned drawing 7 
and the method of aforementioned drawing 13 may be used for the method of the vote to a table 
when positive parallax is searched for. However, it is more desirable to use the method of drawing 
13 , since the interior of vehicles is solid color and parallax detection can do only a profile in many 
cases, when objects are vehicles. Vote performs same processing in all the windows in which 
parallax was detected. 

[0062] A position with the value more than the front shell threshold for vote is searched after the 
vote end of the parallax searched for in all windows. Drawing 18 shows the situation of the table 
after the result by which the parallax used for vote was detected, and the vote end when casting 
one's vote based on it. If a body is large to some extent, the position more than a threshold will be 
detected together with width. 

[0063] Next, Steps S107-S109 explain the processing which detects a body and the becoming body, 
separating the front shell body of drawing 18 . First, at Step S107, the table of drawing 18 is made 
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binary with a certain threshold. The above-mentioned threshold can be experientially decided with 
the height of the body made applicable to detection. Next, at Step S108, labeling of the table after 
binary-izing is carried out. The common practice performed by investigating connectivity is enough 
as labeling. The number of labels of front Naka after labeling is the detected number of bodies, and 
the lengthwise position which detected the label is parallax. Drawing 19 (B) shows the result which 
carried out labeling. Next, at Step S109, a body is detected from the result which is shown in above- 
mentioned drawing 19 (B) and which carried out labeling. In addition, although only the left end and 
right end of a precedence vehicle whose number is one may be detected separately and may be 
detected as two labels as shown in drawing 19 (B), such a case is in the same distance and can be 
judged as one body from information, such as carrying out the same movement. 
[0064] Next, how to ask for the distance and the position of the detected body is explained. First, at 
Step S1 10, highly precise-ized processing of parallax is performed by the method explained by 
aforementioned drawing 1 4 . The procedure is explained. Drawing 20 shows the example of 
processing which performs highly precise-ization of the parallax to the body, when the body of 
parallax "15" is detected in a lateral (7) position. First, the window voted there is looked for from 
the label view [the same as drawing 19 (B)] shown in drawing 20 (A). As shown in drawing 20 (B), 
search of the window voted for the detected label can scan the train in the position of the same 
longitudinal direction as the detected label perpendicularly using the table which stored the parallax 
for every window of drawing 16 , and can be performed by searching the position where the same 
parallax as a detection body is stored, next, the difference for every pixel for which it asked in these 
windows — it asks for the average of a value the difference for every pixel in the window which 
searched for parallax — the difference of the corresponding window as for which drawing 16 carried 
out front shell detection using the table since the value was stored in the table shown in 
aforementioned drawing 1 7 — all values are added, and the average can be calculated if it divides by 
the number of the window Drawing 20 (C) graph-izes this average. In this graph, it considers that 
within the limits of the curve near [ for which it asked in the window under processing ] parallax 
(here 15), i.e., L of drawing 20 (C), is a secondary curve, and let the position (here 14.4) where the 
curve serves as extremal value be parallax. 

[0065] Next, at Step S1 1 1, the distance of a detection body is found using the parallax searched for. 
The distance to a body can compute the parallax searched for by pre- processing by substituting 
for the aforementioned (several 1) formula. Moreover, the distance of the longitudinal direction to an 
objective optical axis can be found by substituting for the aforementioned (several 4) formula the 
number of the longitudinal direction of the window which detected an above-mentioned distance and 
an above-mentioned body. It can ask for the distance and the position of two or more bodies which 
were picturized ahead by giving about all the bodies that detected this processing from the table. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram showing the gestalt of operation of the 1st of this invention. 
[Drawing 2] Drawing explaining the principle which finds the distance from a camera to the candidate 
for detection by the principle of triangulation using a stereo picture. 

[Drawing 3] Drawing for explaining how converting the focal distance f as which a unit is expressed 
in mm into the value whose unit is a pixel. 

[Drawing 4] Drawing showing the result which searched for the parallax for every position to which 
both the pictures in a stereo picture correspond. 

[Drawing 5] Drawing having shown the angle picturized in the window defined on the picture with a 
precedence vehicle and the physical relationship of two trees of the width to two cameras when a - 
picture was picturized with a camera. 

[Drawing 6] It is drawing having shown the table for vote which took parallax to lengthwise and took 
the angle in the longitudinal direction, and a left picture and (B) show a right picture, and, as for (A), 

(C) shows the table for vote. 

[Drawing 7] It is drawing showing signs that its vote is cast for the position in corresponding front 
Naka based on the position of the longitudinal direction of the parallax searched for in a certain 
window on a depth map, and its window, and in (A), a right picture and (B) show the table of parallax, 
and (C) shows the table for vote. 

[Drawing 8] It is drawing showing the result which performed vote in all windows, and in (A), a right 
picture and (B) show the table of parallax, and (C) shows the table for vote. 
[Drawing 91 The block diagram showing the gestalt of operation of the 2nd of this invention. 
[Drawing 10] The block diagram showing the gestalt of operation of the 3rd of this invention. 
[Drawing 1 11 It is drawing for explaining the function to prevent incorrect detection of an 
obstruction. (A) Drawing showing the picture of each window set up on the processing-object 
picture and (B) set drawing showing the positions of each window defined on the picture, and those 
defined scanning zones of a window, and (C) in each window. Drawing showing the state of asking 
for the brightness distribution on one line cut in the parallax direction by two or more places, and 

(D) are drawing showing physical relationship when the object picturized with two cameras and its 
object are picturized on a picture. 

[Drawing 121 The block diagram showing the gestalt of operation of the 4th of this invention. 
[Drawing 131 Drawing for explaining highly precise-ized processing of the obstruction detection by 
the vote method. 

[Drawing 141 the difference for every pixel which is drawing showing the graph which added the 
average of difference, and asked for drawing having shown the window where (A) was able to search 
for parallax on the picture, and (B) at the time of matching — the graph of a value, and difference - 
- drawing having shown the graph of the average of a value 

[Drawing 151 The flow chart which shows the flow of the processing in one example of this 
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invention. 

[Drawing 16] the difference for which it asked for every window — drawing showing the table for 
storing a value 

[Drawing 17] Drawing showing the table for storing the parallax searched for for every window. 
[Drawing 18] Drawing showing the situation of the table after the result by which the parallax used 
for vote was detected, and the vote end when casting one's vote based on it. 
[Drawing 19] Drawing showing the result which carried out labeling. 

[Drawing 20] Drawing showing the example of processing which performs highly precise-ization of 
the parallax to the body when the body of a certain parallax is detected in the position of a certain 
longitudinal direction. 
[Description of Notations] 

I Two — Camera of an electronic formula 3 Four — Image memory 
5 — Window setting means 6 — Parallax calculation means 

7 — Table of the degree of parallactic angle 8 — Vote means 
9 — Body detection means 10 — Distance calculation means 

I I — Brightness distribution calculation means 12 — Distributed judgment means 
13 — The degree storing means of similar 14 — Difference calculation means 

1 5 — Judgment means 1 6 — Vote means 

17 — Distance calculation means 20 — Detection object 

21 22 — Camera 23 — Precedence vehicle 

24 25 — Tree 30 — Operation part 



[Translation done.] 
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m^^y^^zMmm^ttzim^z^xmK 
x— tifrnztm-tz*^ y t . 

flu^r^ * > 9 -cfi *> mmzcomfr o tzmmim tcoim 

[fS*J»2] ±E«^a^ST^fcfiI«^*t*« 

i^tcs^i %t ±ia# > ^ stp t±iB»aj Lfe** * t 

%<iSr^ s «$S£W;M90HffiO{aB^> 
2iXftlRfc^ 3 5:L. *^ft«#Mfc£*ffiB*#W>s 

* #s fc -r 4 3S 2 {zw&<mmw& a^fi <> 

[ff^4 ] _hiB^>f > F^RS^R^RgLfc*^ 

^a*#Riai^«ffl*iT* -5 «t a maus t . zb% 



u«fc<ai6£^4S»as*Ri:. JJB^ffi#Br5&a 
[00 0 1] 

4. 

[0002] 

If. «PBHT 3-2692 1 1 ^«CIB»S fc 

U % ^OfflB^^T^W^y^^^fif^^^t 
[0 003] 

[0004] *¥&m±slV>z:b Sfl£*fttB^ra)HSr» 

« z t n&mh mmmm&^z * r t * a w k 

[0005] 

if. x^fP^Bfll^tc^-f yp^frRffiL. R^Ufe 
*74yY*?mzHm BrSHPBSrPHTT 
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tt«K:BTse«*ini»'t*«ffl (ism) *&Mywtz 

LT*»rr4 X o ItZt&tfL L?zk coTfo 4 . Z<7)1>mz£ 

tin. m^^mw^&Mm.mcom^^z^h^ 

[00063 W:. H«3I2 tcKH^R^fcv^T Ji. 
±!2<0«9tt £ fcffiK it 4 tli^IdO^ * X ± 

ism 2 <75satcojB«ccffls-r & . 

[00071 8*:, ||«W3 fcE«OSWBtt. WJ**2 
fcfc<0T*4. zcoXolzmfct&ztlzlL*). W&> 

Tmmnwmxftzttozktfft*** **** -t 150 
«da±«»ii(ffif£»4 co2m<7)ffim<n— mzm m*t 4 <> 

mt LX, *M >H^rt^a^W^4MRtrSWI>**Jfe 
4. ±E^|i«li«iJffi^3<0^^»^ 



-*te*s-*-4. 

[ooio] jwc. ms^e^zim^mzis^xii. 

^<2:4. Bfft«4X7y«^5^ 
co^yH^ fcjft**4 ^£ if mn*? 4yY*> R*fc 
<I£Ri*$-£4C: b&X*Z &tz&V$gVai<otfi%\fmmiz 

co-UlzttM-tZ. 
[00 11] 

4 T-^SgSI b * ^ 5 <n%Mfrt> * aj«5# * tW* 5 ^!*] 

/c, m#&4iz&^ximimft<?>im&wft±'t&£ 
xmmme^z^ximm^m^^^t^ ^mkmco 

4, 

[00 12] 

[ %ffi<DmM0>&m ] ( SB 1 comMcoBM ) H 1 l 
^cT^f X\ ^oaMRfficOTK^tt^Rl 1 5 -< v±£8J "3 i: 

ism t . *pfa*o»w*iS:«tai-f s «t 3 ^ffitft-r a - 
kfc-c*t. 2 0i4a*^«r*fc»^*i»***^ 

teSSSFCfc 0 , ^J^tfCPU. RAM. ROMtffri 
i^v^T. 3. 4«*<x^ii*^9 1s 2*»feA*tfcS 

[0013]12il Xf-l/^li«$:ffl^TH^fi^ 
BB^40"Cft4. 02^i5^T(4. ^^^A (huIE*^ 



I 



(4 

*Wfc<Offi»Srj£p (x, y, z) k Lt^l). 
[0 0 14] 0 2 3 gu5gg«f s 
SI (PS^^fSOSElli) D^mre$>9. XMtfK^z 

Z=f • D/ (xa-xb) =f 
BMfc£ 640x480k 1BS?>*:££14 

[0016] ±ie mi ) $i<7>ifkfi$mf im&zmm 

kLTfHILTV^^\ MMSeM. f li-i-fi^m 

t^iw (mm) ottftttSrEEJIIz (mm) BHxfckc: 

ClkCcJ: 9. TIE (IS2) St^^-i:^ 
[00 17] f = z • wx/W — (ffc2) 

fcTB&B) ±(^^T^P^ffi»S^TV^^ (xb, 
yb) tCitJBf 4flS*-<7)B« (fflliJfWRA) ±^ 
(xa, ya) Zl&fr? • LT 
{4. HtfeB±c7)^ (xb, yb) £-£t?!g&®B^B<£ 

I 0 0 1 8 ] 04 PH«^>StJ55^4fflB*W>SM$: 

B& (#fl;ii£B&A) 1pt>*:<r>*7A vF^kfitStRffi 

t£«WC. (A) {42EBffi (■«A£ffiS> . (B) \$ 
=&B«(B«B(2ffi^). (C)tt«l6tf>*L (DM4 
r 1 5 j O^-f vH^ffl^co^SrftSaJLfcHflS 
£:5cf. 04 (B) , (O <O(l)M20)li*^_ 

^fyH^*WfS] (KIT, «t£rfflk !£■?") OftSSrT* 

miz& ^X ii (1) — (20) £ Aft # L*O^I> e * 
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IB (»1 ) rtiO**)*^**?**. 
[00 15] 

D/S — <R1) _ 

fc. -ow , )'f ^ H^lli ( x*W^>*8 ) #*xw. ft 

4 yH^«<0S^*«mif. miS (SI ) sKSrfflv^- 

i T'^EEBI £ *af> £ £ k «*ai# 6 . 
[00 19] KIT. B^ioC^^F^Wc**)!*! 

CD*§£\ ftfri&k. 5fe^«*^-r*KT^»ffiki±l«l 
BBl&tfre. 04 (D) tofcta^'M yh'^tia 

?f*kWt«»t1lcsti*^*. «itfH4 (O <DT*> 
^2^fT@C2 r i 5 j ^ftfrl&ItCaltttT^S^-blB^ 
»*H=ffl3-*-&. H4 (C) fc»*vc % 

r 1 5 j ^m^LTV^^^ffm^ffl^L. 
(3). (4)?i|^«a r 1 9 j tfim&LX^&Mi/rtfi r ^ 

[0020]i5il 04^L7tBffiS:^^^"C«« 

9tffM2 3 k ^-c^filco 2*^0*2 4 (ffH2S*^^ffl 
i) . 2 5 (IBE+*<50*te«S) ^SBB^k^Bffi 

[0021] ttz. men. ffljto\z&&. fltsrmtft 

J^C04. H5CO(1)-(20)D Z b ~>fcim • ft&V>m 
»«W^)«k*-fe> SrSLfcHTftO. (A) 

[00 22] 4fc. 07(4. ggRtHfiUi^^^^^H 

HT-ftO. (A) <B)t4«»!0*. (C) 

( C ) coft&MTim r 1 5 j cOfiLSt- r + i j *«Jo 

n$ti&. 07 (b) <r>mx\$, ^s(8)cofl[S^^ii 



« 



(5). mm^l 1-34 5 3 36 



r 1 5 j & 5 WPBEt ft»Wtei4ftJK(8)T* 
[00 23] H8fcL ±Etf>«S££Ttf)'>>f>' 

flL (BMttH&o*. (C) \taB3&m*MiF& . 
[00 24] H5*»fc¥flSJ:ot3. H4 - ClftSLfc , >>f 

cox o %mmi& Srfflv^T. s 7 te* t fzitt~cm. tea 

£#&flT'#£o H8tC5rr«Tti. «*(3h (4) TEH 
r 1 9 j c7)gp^ (fetcO*^:fflS) > ftJ£(5)~Cim 
r 5j coSB^ (4»ife^*^*S> > ftK(8)— (16)-C« 

& r 1 5 j S) TaRWR+U ft 

jWS<=5:oT^&, 

[0025] JifBO^SiTli. ^^Sti^Ll^l 

tarn t a^%*^^as t> w t jaa-cfr * **ai* 

[ 0 0 2 6 ] 0 1 tc^L^SB 1 O^ifiO^^^T 
(4. ±EO#^*#^SfcLT*Lfcfcmr*»3. * 
4 yK^i&^K5T*_tiB#*M VF^tRSU «H 

<a«B*>»> 7(4_ttBS7 (c)cfflsu a*#a 

H8 (C) ^L3t«*^Hr^U*v^3Lt^{a««r 
[00 27] KLbifcHJiLfcri: < . * 1 «0**fc0»»t 

fflf &J: 3 Kit* I/O**. Zcotztb. imnmifci*- 



[0028] (JS2C0»*C0»«) JXfc:. H9«4»2<J0 
HSfc9»»*5rr:7n >y ? BT* & . Ztlli buIBH 1 fc 

O&M (3tW^^>Mm^^rcOx^c7)gESi. fulfil 

5cdxi. x2i) £*a«-4. stes i commco&m 
-vmmLtz ioiz* us (c> Ltz&m 
(mjzma±<7>m*^®M) J4. 

[0029] ist* ^<ott«*»*KWi . a-r* * 
^oti8 (c) Ti»*3^«iajs<i^«i&«ofii (flute 

[0030] mzffi%ft<oim*&#>2>. m5&hm& 

*«5J±«W*Wfc:TIE (»3) &X"&*bZ>Zb&X'* 

6 = t an 1 (xw/f) (£fc3) 

*. 4^c. xwiJit/f ^ffittHSR'Ca * . 
[003 1 ] JB^^fil^^SXL (3KW±*^ ! l*rf* 

X\ (38c 1 ) ^T^^/iEBSIk^ftSt-S-^^T. T 

IB ( »4 ) C k I) . 

XL = Z • t a n C ( N — M) ■ 8 ] - (IR4 ) 

aco(io)D . «a%#^fi : mo^'i4Ni4 7 esse* 4 

ii>7#@c7)(7)] T*S>&. =5:43, XL<0t±***«3iatt 
J: OtffiS^fcSkS. XL>0«4£ffl9lcS>^k^$:7js 

[0032 ] H5C0ffllO*&W4. 7tlfc&^]i4^S(10) 
TftO. B*Z^Lltr***»f<W>fiWi«JK(7)C 

xl=Ll-tanC(7-10) • ==-L 1 • t 
an (36 ) 



t 



I 
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x2 = L2 • t an C (3- 1 0) ■ 0) = -L 1 • t 
an ( 7 6) 

[ 0 G 3 3 ] J2Lh»^BUfcrk < . » 2 

k ttflWHi k v * 3 *Kt v * T^BB k « 

^rWtoffiak^PS^rSrttK'TS*. (WWflMBt* 

wacffsSfj^k^ai**. 
[0034] (m3^mm^BM) hi o(±*«51<d* 

i . 1 2 . 1 3 . a*** 

[ 0 0 3 5 ] EI 1 1 t4^^IH«a«rB6jt^4«IB.tR 
WTifc^HT* 1 ). Hi 1 (A) Ji. *Ba*tftB« 



— l ^ 



i(b) i,z^xd%MMnm&*w&Ltzm&te s m 

11 (A) CO (a) liitt^vHi) (HHHSfufcB 
v >g£# K ( b ) { k Tfr^f*] fc*f *tx -y 

(d) iiy^fX^W^^^^t. 
(a) — (d) K:feir^T*EfflBOTte«Lfc^57»i. 

yyitt. -e^973&»fe»/Jyit*a"*"«Ik*cJ:^Tv 
yf-y^tiLB (3t^«/hoffla=aiRK* ? **^ffi 

[0036] Sfc. Hll (B)J±. ■ALhtCjaiLfc 
(a) — (d) *ti?ti<W4 yF^fitt 

fc. 01 1 (C) tt. WW^^^ (a). — 

( d ) iz&^x. imjjmzty~o?z 1 94 y±oaus^ 

fc. HI 1 ( D ) teL Zo^^7t«L^fftfc 

[0037] «r*5. JiffiOH^kti. WM«fcffltfre> 
Wtt^rio MS. a«Kkft»tt»:^«-C* 

(x-x_)(y-:z) 

— — ^1 



r cs(x 

0^M#=X i x-y I 

=5rfc. ±5£CfcOT, xli;S2£B« (B«A) tf)2S£. 
xte xW%tt. yttffi**>B« (H«B) <7)5S£. y_ 

[00 38] m?M2lZ*kLtz£olZ^ lo^^7^ 
*§-£\ S v ^11 _LtO-7 >y f y /fit 7 ^ >±. 

izcr>&. z<vztfrt>. mvxm&<omm&m i 

BrSii^Bffi^^r^ffiBk^Bft^)^^ ^H 1 ** 
^HL^ffiak^k LXiRubbtih. £?z. *B&£ 
«Wi«kLfc«^. Sltl^iU^^^^ 
Ov-yf-^ftBli. Ill 1 (D) tojcT <k ? ££B® 

Lfccia*^=&*"W»3^r<xtf ± < * ^te^ 

4«*^v 7 f y/ffllS Wfiii: irS . Hll 
O^iJTii. Hi 1 ( A) O ( c ) cofyyttZfikLtzX "5 

[00 39] ±fScO i -5 C3 S Hll ( A ) liQoO^^ 



-x) 1 ) /" CS(y-x) 8 ) 

Bttk*#*^fc«*i:tf>*> ka« («^B«kH 
*S:*46/iB«kOtia<Og|) k^BM**^97-fbLfc 

a^iRK^SfclSv^Bk^i). L^L. 

1 (A) ^ (a) COidCC. WyK9t»W>HW 
t £ft*ffq t fit k 'S: h fztb$lMZm> i> - k S % 

^^{aai^*^^^^*L^t^T^v^ 

6. Sfc. Hll (A) eo (b) coi-JtcWakT^ 
&x.yisifim&ZtiX^&ifi* ( a ) k 

^tcotr^rv^BjifittjWS^. -r^^>±ie (a> . 
( b ) co£otc^izi&frtzmmmnwcofmi,z%& 



I 
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[0040] J3TC\ -hlB^J: ■J^^Ii^KW 
<#£*i»B*'*4. Hi 1 (C> >F*K 

94 vF^W£4MMi* ( a) co£d 
ftm&WJ yF^Cfcv^Ti. ( b ) c^i 

[004 1] i>>f 

Jtf * i: . ( a ) <0*&H&co? >f y F ^Ttt^iW'h $ < 
(b) <D^4 >-F^#tfct£*#<^T L£ 

00 L*>U 011(C) £*LfcJ:5fc:«194;'<D 
*K**ffi-«Uir. < a ) ( b ) Jiftfcfltttf'hS < * 

f&&£n<^4 yF^£K9l&<-^T#. RWMcft* 
[0 04 2] ffiS^aSJtt. HI 1 (A> ^ L 

flfico^ 4 v F ^JS^-fa fc Tlftx >/ xLt^ft^ > 

01 iff. Hll ( A) co (d ) Xcr>fo&m 

mxn. nm<mi i (c) 

anil lt t> . «r ofaattKWjiGtaai^fc 

[0 04 3] HI 1 (A) tciSfJrSfc* «aaeHl*rC 

lz~tZ>ZbtfT*&. Srfc. JJEHl 1 (A) ^9:7 

[0044] ±IB<DJ:3^ ^-fyH^tJ^tffll 

94 yi^SSW*^^ yicfc^ 



of^lt^i) ^/hSv^ift^tcti. SWffio»rffeft# 

[0045] ig 3 <omm<mm^ wc mm#%m 
m#si i T±ia^« i 94 y»*>#ii**H}u 

£¥«J»rU L*\<Ma±<nm&l r zcDfr<XcD&m^®&l<z 

[0046] tLbiKWLfcri: < . »3^JfcO»JIR^ 
*5V^Tii. ^yF^ttteWtSU***^^^^ 
S0ScOly®Si: LT. ^4 V F^rt^^^^I^tJcSr 

F^C*3»t4i^tl«S:«*"C* ft^-CJPI^flia^* 

-i). Sn^T. v^v^^HBi^yF^Kiwt** 

[0047] KUItKmLfc^^vF^fctJV^ 

[0048] (»4<0H»^0»1B) H12tt. *«HB^ 
^4 oSESfiOJSffi Sr^-r^n v ^ WTCh & . - comM<0 

Lfcrai^)«i: ftJW»*flrt-*«BtWtfc few* 
*. H12C*JV^T. 16J4»»#S. 17{4IE«»tB 

[0049] a-r. mftmftnnmmmmiz^xm 
*Jttt. HI 3tt. a»s«teJ:*ww»ai^>*»*ft 

Sa^t^ittW-t &£tf*7>HT*S> Os ill TiJl^B Lfc*ft 
TflBStt^iSv^ v F^^Hft^tiSlLfclSSSffl 

«ajLfc^4^F^*rtfc«iSi:tea^v%T. 

ffi^ffl*jB»^ft«tW**LfcHT*)S. 
[0050] r ^^;ua«Wifi"Ht^^S>^^^ 

t fca»6« i BSW^-^-r ua a z. tw$>< <> 
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E3f HzSH-f & iok: L*: t COT* ^113 KacTWC 
14. J1JK#(8)T1EII# r 1 5 j OfflWClSISrAftS 
±ffi(afflffi£ti3K£Aii. *^±T<OfflBffc: 
(4*;ftWi2B£A*u ^&^Wf«4>eii^ixl M£ 

m& o a y y iz& v ^x m t wmttii aj s *ut t 
[0051] mz, wmnftnmm&itwmiz^xm 

IT* 0 , Hi 4 (A) nmSLt^zmM^^bhUb^ 

x^ti^A yw^TtkLtzMTfo*). 014 <b) &m 

^C*3 v vc > v -X 7miz&tbtz&SMte<?>&ftB<n 

l x a<#> tist <aa^)^?& l / 2 ^siT-t 
[0052] mwxoiz. m 7 <r>mz ± xmtn Ltz 

<»1 ) jSXftVf 4 Z t lz£~>XiYM*th Z 1 ti*X"£ 

4. l*»u m^^fr%nmm^m:hhtz&w. 
Xotzmmt Lx^frbtitztmiz&^imzwt-t 

4 2»|ft»fcffiU^£LT^&. ^£9. &&ZZC0 
2iS:fflScoffiffifc LT#ak4 0. »»h# 

<r>^\mwjt\,z**frhmiL<?>*?4 y f^t^tv^ 

ztihco^A y vy±xiz&\,^x$itbfz7&£&ffl 

mz&ttz&wm&com^co^&iZ'&th* 



ztL(,zm&i>cox'i±*<. x vK&co&mzmii 

Xl>£\^ 9 

[0053] 01 2<vmm<wmtz&^xi±. aw^s 

1 6C*5Wt, Hi 3t«B^Lfc1WM^^K»*<fcffi 
SSrft&W gB8IS:ai¥S17-C(4H14'CiaPHL7t8E 

[0054] ojjm LtzztK.mi <^mmcommtz 
&wo4. s^«si<oRi. zcommcomzh&^mz 

tmrthUmiM^tztz^ MFHtM&&b'liz£ 0. f^I 
tffiBltc$> 4 fc: t, *>^*> fe-fffiH^ 1 B*#rtfW-»2r* 

[0055] itz. *+T*^Lfcft*<OEItSrtt«t" 
T&*ft«S:2»:*«i:^ s S:L. *^)ft3»*«ffi<lfc5S:4 
[0056] (USSfl!) <&z. Ztl£XW91Ltimi^ 

m4co$m0>&m$:m^x. ji»fi*£&6 2*o*fc 

"TSISJfiWI^ov^iB^i. ^dT14. mrlEH2^ 
U:i3C, 2^O^^^O7t»^ a Ffi : ^0s 

2 -&cr>l)* mym&n— ?4 y±KJT>h i ? ^I£S t 

[0 05 7] HI 5(4. z<nmMmz&»&9m<?>7u 

-?-T—bX'$>&. H15^V^T. ^T7rS 

i o ot(4. mm^ii'tto. zcr>wmj£X'i±. m 

?'J7t*. ^^-C%JMSBe«:*T*9»4. HI 6^ 
T77S 1 0 4TiSBfl) -T&fctfXOSfc. HI 7^f 

Xfoh. ^rfc. HI 7 (C) „ (D) fo7jki-18M*mm 
comzn^X. r-ij tlSKLtft6^4. fflH*«* 
^^ix^rV^h^^^^^-CfcO. HI 7 (C)#*0 

to 

[0058] <WC„ Xf7/S 1 0 lTi4B&A^SrtT 
^5:5. dCT-«4, ffiTiaH2cOB«Ai:B«BS:A^ 
4o K^fyrs 1 0 2T14. t*%^>*>— ^B«± 

w>fyH^^i (»je) -r^o -dTi4. t?naH4 

Iz^LtzXoiz^ i(: 1 01, iC2 0i^tH0x 
[00 59] »:^ > Xf77Sl 0 3 — SI 0 6tefe^ 
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yF^fcrfcwt. HI 1 (C) -CK^UfciDSIS:^ 

(^T77S10 5) ^mH^SWK^JQS (Xf77 
S 1 1 0) T^«H*r&<7)T\ HI 6^:#^^yh'^ 

[0 0 60] mz. ^T77S 1 0 5^4. fltfflLfcS 

fc:££l£HI<D¥^ffi[ k «/M£4HI k <nm i , * on 

iehi i (a) ?m*MLfz9mx*h&. zemmiizt*^ 
•y7°s i o eTfK^oaaifcffofcttfciac^^ >- 
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